Efficiency and persistence in models of adaptation 



R. D'Hulst and G.J. Rodgers 
Rene.DHulst@brunel.ac.uk and G.J.Rodgers@brunel.ac.uk 
Department of Mathematical Sciences, Brunei University 
Uxbridge, Middlesex, UB8 3PH, UK 
(February 1, 2008) 

A cut-and-paste model which mimics a trial-and-error process of adaptation is introduced and 
solved. The model, which can be thought of as a diffusion process with memory, is characterized 
by two properties, efficiency and persistence. We establish a link between these properties and 
determine two transitions for each property, a percolation transition and a depinning transition. If 
the adaptation process is iterated, the antipersistent state becomes an attractor of the dynamics. 
Extensions to higher dimensions are briefly discussed. 

PACS: 02.50.Le, 89.75.Fb, 64.60.Ak, 73.20.Jc 
Keywords: adaptation, collective behaviour, percolation 



For some time, physicists have been working on prob- 
lems outside the scope of traditional physics, as illus- 
trated by recent papers on the cooperation between ac- 
tors Q , the repetition of ancestors in genealogical trees 
H or the scaling of football goal distributions In 
many of these systems, whether they are in economics, 
the social sciences or biology, the process of adaptation, 
or how an agent or organism adapts to a particular event, 
plays a very important role. Unfortunately there is no 
general theory of adaptation which reflects either the 
ubiquity or the simplicity of the process. In this Let- 
ter, we introduce and solve toy models for adaptation, 
in order to identify some basic properties of the process. 
We investigate the dynamics of a trial-and-error adapta- 
tion process, which can be represented as diffusion with 
memory. First, a random guess is made, then, the system 
reacts to this initial guess. After this two-step process, 
it is interesting to consider if the adaptation process has 
improved the original random guess or not. To answer 
this question, a measure of efficiency of the adaptation is 
necessary, and we will show that this property, efficiency, 
is closely related to another property of the adaptation 
process, persistence. 

Although we will not explicitly model microscopic el- 
ements, it is helpful to suppose that there exists some 
microscopic adaptive entities, generically called agents. 
These agents are trying to guess what the best action 
would be and the result of their aggregate decisions is 
a macroscopic parameter, x. After this initial step, the 
agents detect a global result which is the difference be- 
tween x and 1/2. The individual reactions of the different 
agents to this information produces a diffusion of size p 
from the larger population to the smaller one. The ideal 
reaction would result in x = 1/2. However, they lack a 
leader who can synchronize their individual choices and 
achieve perfect coordination. If there is cooperation, it 
has to emerge spontaneously from the system. In this pa- 
per, we do not concern ourselves with the precise details 
of the implementation of the agents' decision process, nor 
on how they adapt. The only questions we investigate 
are the influence on efficiency of the size of the adaptive 



population, and how efficiency is related to persistence. 

Consequently, the model is defined as follows. In the 
first step, a quantity of length 1 is cut into two pieces of 
length x and 1 — x with probability fo(x), as shown in 
Fig. |l| (a). In the second step, a fraction p of the larger 
piece is cut and pasted to the smaller piece, as shown 
in Fig. [l] (b) and (c), respectively. This transforms the 
random guess distribution fo(x) into an 'educated guess' 
distribution fi(x). In the model, we imagine that we 
are macroscopic witnesses of some microscopic adapta- 
tion process, which is not modeled explicitly. The object 
of the model is to investigate the appearence of coopera- 
tion between microscopic entities in the absence of global 
control. Here, cooperation is synonymous with obtaining 
two pieces of equal length. After the two step process, 
a record of the improvement in cooperation is made by 
updating a quantity A. A — » A+ 1 when x is closer to 1/2 
after than before adaptation and A — ► A — 1 otherwise, 
with A > 0. We assume that the model is played several 
times, without any correlations between the different re- 
alizations, apart from the fact that we always start with 
the same distribution fo(x). A is a biased measure of the 
rate of increase in cooperation after adapting. Adapta- 
tion is driven by the prospect of improving on an initial 
situation, which keeps A non-negative. 



1 st cut 
with prob fg(x) 



(b) 2 nd cut | 1 | 1 | 1 

(1-p) x p X 1 - X 

(c) paste | 1 | 1 

(1-p) x p X + 1 - X 



FIG. 1. Schematic view of the cut-and-paste model, where 
we take x > 1/2, without loss of generality. 

For simplicity, we consider that fo{x) — /o(l — x), 
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implying that fi(x) = /i(l — x), where fi(x) is the size 
distribution after adaptation. This distribution is given 
by 

,1/2 

fi(x) = / dy fo(y)6(y + p(l -y) - x) 
Jo 

+ [ dy f Q (y)S(y(l - p) - x) (1) 

Jl/2 

with a mean value mi = 1/2. The magnitude of the de- 
viations from mi determine the efficiency of the system. 
There are several quantities capable of measuring these 
deviations and they all give qualitatively similar results. 
We choose to use the variance a\ of fi(x), equal to 



a( = (l- P ya 2 + 



2 2 , p(3p-2) 



+ 2 P (l-p)K (2) 



where CTq is the variance of fo(x), and we define 



1/2 



xfo(x) dx. 



(3) 



For this measure of the efficiency, the optimal value of 
the adaptation is given by the minimum of a\, 



Pc 



Aa 2 ~ 4if + 1 
A<7 2 Q -8K + 3' 



(4) 



The boundary between doing better and doing worse 
when adapting is determined by of (p*) = (Tg, and this 
gives p* = 2p c , independent of fo{x). 

However, as we mentioned earlier, we assume that 
there are no correlations between successive realizations 
of the model. Hence, of represents a statistical measure 
of efficiency over several realizations of the model, but 
this is a quantity that is not available to anyone seeing 
the game played once. In other words, if we imagine an 
agent taking part in the cut-and-paste model, his mea- 
sure of efficiency is based on one realization of the model. 
The probability T(p) of improving on an initial guess is 
equal to 



r(p) = 2 



(l-p)/(2-p) 



/o(x) dx, 



(•5) 



which is a monotonically decreasing function of p, equal 
to 1 when p — and when p = 1. Like of, T(p) 
is not a property directly available after one realisation 
of the model, but it gives a probability about the out- 
come of one such realization. If we remember that, after 
adapting, we want to make a judgement upon whether 
adaptation was worth it or not, T(p oa ) — corresponds 
to the onset of adaptation. That is, for p < p oa = 1, 
it becomes possible that adaptation leads to an improve- 
ment, which is similar to a percolation transition The 
order parameter of the transition is T(p) which scales 
as r ~ [p oa — p) 13 for p less than, but close to, p oa - 
The value of the critical exponent (3 depends on the 



analytical form of fo(x). For T(p an ) = 1/2, the sys- 
tem undergoes another transition, from non-adaptive to 
adaptive. For p > p an , A stays close to 0, while for 
P < Pan, A is 'depinned' from and goes away at a veloc- 
ity v an = 1 — 2T(p). This velocity, equal to for p > p an , 
is the order parameter of the transition M. For p < p an , 
the symmetry between adapting or not is broken. 

The two previous quantities, of and r(p), are both re- 
lated to the efficiency. Another important property of 
the model is its persistence, which measures the propen- 
sity of one piece being the smaller piece both before and 
after adaptation. The probability that the smaller piece 
remains the smaller piece after adaptation, the persis- 
tence probability Tl(p), is equal to 



n(p) 



(l-2p)/2(l-p) 



fo(x) dx 



(0) 



if p < 1/2 and zero otherwise. In fact, persistence and 
efficiency are closely related quantities, as can be seen in 
Fig. H For any position a; at a distance d from 1/2, the 
symmetric position with respect to 1/2 is at distance 2d 
from x. In other words, if d marks the boundary between 
antipersistent and persistent, then 2d is at the boundary 
between better and worst than the previous step. This re- 
lation is expressed mathematically by the fact that simi- 
lar properties for efficiency and persistence are character- 
ized by T(p e ff) = Ii(p pers ), which implies p e // = 2p pers . 
For instance, the onset of persistence and adaptation 
are characterized by Tl(p op ) — T(p oa ) = 0. From the 
previous relation, one obtains the relations p oa = 2p op , 
where p op signals the onset of persistence, TL(p op ) = 
and p an = 2p ap , where p ap signals the antipersistent- 
persistent transition, H(p ap ) = 1/2. Hence, a character- 
istic property of persistence in the system requires twice 
as much reaction from the system to have the same effect 
on the system efficiency. Note that the antipersistent- 
persistent transition corresponds to a symmetry breaking 
between left and right for p < p ap . 




FIG. 2. Relation between the value for the best adapta- 
tion (d) and the value to obtain the symmetric situation with 
respect to 1/2 (2d). This relation is at the origin of the con- 
nection between persistence and efficiency. 

We illustrate the previous results in Fig. || with a 
uniform distribution fo(x). With this choice, p ap = 1/3, 
p c = 5/14, p op = 1/2, p an = 2/3, p* = 5/7 and p oa 
1 . We have chosen to show the different functions as 
functions of l/p to allow a visual comparison with the 
Minority Game, as we explain later. 
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FIG. 3. Variance a\ of /i as a function of p (left scale), 
persistence probability II and improvement probability V as 
functions of p (both on the right scale). The initial distribu- 
tion fo(x) is uniform on (0, 1). The dots (•) mark the special 
values of p considered in the text. The dashed horizontal line 
shows the variance of /o (ap- 



points that are equivalent to x. If x is the initial guess, 
falling inside the circle after adaptation corresponds to 
improving on the initial guess. 




FIG. 4. Adaptation on a two-dimensional plane. If the 
adaptation is along 1 or 2, the model is similar to a 
one- dimensional model, while for adaptation along 3, there 
is no better-than-random phase. 



Assuming very strict bounded rationality [^), we have 
considered up to now that the system was adapting once 
only. However it is straightforward to apply the cut- 
and-paste model recursively. After an initial cut with 
distribution fo(x), a fraction p of the larger piece is cut 
and pasted on the side of the smaller piece, creating a new 
distribution /i (x) . Then, a fraction p of the larger piece is 
cut and pasted on to the side of the smaller piece, creating 
/2 {x) , and so on. The main conclusion is that the system 
can be persistent for a transient period, depending on 
the initial conditions, but that it will eventually enter an 
antipersistent phase where the left piece is alternatively 
the larger and then the smaller piece. For a given value 
of p, the system has entered the antipersistent attractor 
for all initial conditions after 
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adaptations. We find that 
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lim fi(x) 



1- p 

2- p 
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and the system becomes fully efficient only for quasistatic 
adaptation, with the larger and the smaller pieces ulti- 
mately becoming equal if ji — » 0. 

Finally let us mention that the cut-and-paste model 
can easily be extended to higher dimensions, using vec- 
tors x and p as the random guess and adaptation re- 
spectively, and another point a as the implicit aim. We 
present a two-dimensional example in Fig. |J. As seen in 
the figure, depending on p, the adaptation is either bet- 
ter or worse than random, the best possible adaptation 
being along line 1, a better than random adaptation can 
also be achieved along line 2, while along line 3, the adap- 
tation process is always inefficient. The circle marks all 



In summary, we have presented a cut-and-paste model 
to mimic a trial-and-error process of adaptation, and 
showed that the model displays two properties, persis- 
tence and efficiency. A pair of transitions is associated to 
each property. A pair is composed of a percolation tran- 
sition, corresponding to the onset of the property, and a 
depinning transition, corresponding to the growth of the 
corresponding property. One particular point to under- 
line is the close relationship between efficiency and per- 
sistence. A characteristic property of persistence in the 
system requires twice as much reaction from the system 
to have the same effect on the system efficiency. If the 
model is iterated, the system always reaches an antiper- 
sistent state, where the left piece is alternately smaller 
and then larger. Our model is inspired by the Minority 
Game, a model to mimic the exchange of a commodity 
between agents which, despite its more complex features, 
displays transitions similar to the ones presented here 
P,E0[. We will provide a detailed comparison with the 



Minority Game elsewhere 1 1 1 , but here we presented Fig. 
|as a function of 1 jp instead of p to allow a visual com- 
parison with the variance of the number of buyers in the 
Minority Game |i"o[ ] . Numerous properties found here are 
reminiscent of the Minority Game. For instance, while 
much of the analytical research has concentrated on the 
system efficiency, it is the antipersistent-persistent tran- 
sition which is best understood, thanks to an analogy 
with spin glasses Jl^]. Another point to note is that the 
critical parameter of the Minority Game, a parameter 
called a, has two important values, a c where the vari- 
ance is a minimum and a* where the variance is equal 
to a random guess. These are related by a* ~ a c /2. In 
fact, we argue that the original Minority Game is itself 
an intricate formulation of this simple mechanism, where 
the size of the adapting population is a complex quan- 
tity depending on the history given to the agents and 
the strategy space. The simplicity of the cut-and-paste 
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model suggests that many of the more complex features 
of the Minority Game may be more common and univer- 
sal than originally believed. 

One of us (GJR) would like to thank The Leverhulme 
Trust for financial support. 
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